The first benchmark results from the MLPerf consortium have been released and Nvidia is a clear winner for inference performance. For those unaware, inference takes a deep learning model and processes incoming data however it's been trained to. MLPerf is a consortium which aims to provide "fair and useful" standardised benchmarks for inference performance. MLPerf can be thought of as doing for inference what SPEC does for benchmarking CPUs and general system performance. The consortium has released its first benchmarking results, a painstaking effort involving over 30 companies and over 200 engineers and practitioners.